Amazon Mechanical Turk: A Research Tool for Organizations and Information Systems Scholars
نویسنده
چکیده
Amazon Mechanical Turk (AMT), a system for crowdsourcing work, has been used in many academic fields to support research and could be similarly useful for information systems research. This paper briefly describes the functioning of the AMT system and presents a simple typology of research data collected using AMT. For each kind of data, it discusses potential threats to reliability and validity and possible ways to address those threats. The paper concludes with a brief discussion of possible applications of AMT to research on organizations and information systems.
منابع مشابه
Opportunities for Crowdsourcing Research on Amazon Mechanical Turk
Many crowdsourcing studies have been conducted that utilize Amazon Mechanical Turk, a crowdsourcing marketplace platform. The Amazon Mechanical Turk team proposes that comprehensive studies in the areas of HIT design, workflow and reviewing methodologies, and compensation strategies will benefit the crowdsourcing field by establishing a standard library of repeatable patterns and protocols. Author
متن کاملHow to use Mechanical Turk for Cognitive Science Research
In this half-day tutorial we will describe a new tool that has emerged in the last 5 years for conducting online behavioral research: crowdsourcing platforms. The term crowdsourcing has its origin in an article by Howe (2006), who defined it as a job outsourced to an undefined group of people in the form of an open call. One of the main benefits of these platforms to behavioral researchers is t...
متن کاملThe cultural work of microwork
This paper focuses on Amazon Mechanical Turk as an emblematic case of microwork crowdsourcing. New media studies research on crowdsourcing has focused on questions of fair treatment of workers, creativity of microlabor, and the ethics of microwork. This paper argues that the divisions of labors and mediations of software interfaces made possible by sociotechnical systems of microwork also do cu...
متن کاملCan we get rid of TREC assessors? Using Mechanical Turk for relevance assessment
Recently, Amazon Mechanical Turk has gained a lot of attention as a tool for conducting different kinds of relevance evaluations. In this paper we show a series of experiments on TREC data, evaluate the outcome, and discuss the results. Our position, supported by these preliminary experimental results, is that crowdsourcing is a viable alternative for relevance assessment.
متن کاملRepurposing Facebook for documenting personal history: how do people develop a secondary system use?
Introduction. This study investigated a type of postadoptive system use behaviour that is derived from the original purpose of the system. We defined this type of postadoptive use as a secondary system use as it is different from the primary use of the system for which the system was intended. We focused on the way that Facebook can be used to document personal lives, in addition to using it as...
متن کامل